Neuromorphic Eye-in-Hand Visual Servoing
نویسندگان
چکیده
Robotic vision plays a major role in factory automation to service robot applications. However, the traditional use of frame-based camera sets limitation on continuous visual feedback due their low sampling rate and redundant data real-time image processing, especially case high-speed tasks. Event cameras give human-like capabilities such as observing dynamic changes asynchronously at high temporal resolution ($1\mu s$) with latency wide range. In this paper, we present servoing method using an event switching control strategy explore, reach grasp achieve manipulation task. We devise three surface layers active events directly process stream from relative motion. A purely based approach is adopted extract corner features, localize them robustly heat maps generate virtual features for tracking alignment. Based feedback, motion controlled make upcoming converge desired spatio-temporal space. The controller switches its sequence operation establish stable grasp. (EVBS) validated experimentally commercial manipulator eye-in-hand configuration. Experiments prove effectiveness EBVS track objects different shapes without need re-tuning.
منابع مشابه
Eye-in-Hand/Eye-to-Hand Cooperation for Visual Servoing
The use of a camera in a robot control loop can be performed with two types of architecture: the camera is said eye-in-hand when rigidly mounted on the robot end-effector and it is said eyeto-hand when it observes the robot within its work space. These two schemes have technical differences and they can play very complementary parts. Obviously, the eye-in-hand one has a partial but precise sigh...
متن کاملUncalibrated Eye-in-Hand Visual Servoing
In this paper we present new uncalibrated control schemes for visionguided robotic tracking of a moving target using a moving camera. These control methods are applied to an uncalibrated robotic system with eye-in-hand visual feedback. Without a priori knowledge of the robot’s kinematic model or camera calibration, the system is able to track a moving object through a variety of motions and mai...
متن کاملVisp: a Software Environment for Eye-in-hand Visual Servoing 2 Image Based Visual Servoing
In this paper, we describe a modular software that allows fast development of eye-in-hand image-based visual servoing applications (ViSP states for \Visual Servoing Platform"). Visual servoing consists in specifying a task as the regulation in the image of a set of visual features. Various issues have thus to considered in the design of such application: among these issues we nd the control of ...
متن کاملUncalibrated eye-in-hand visual servoing: an LMI approach
Purpose – The purpose of this paper is to present the control of six degrees of freedom (PUMA560) robotic arm using visual servoing, based upon linear matrix inequality (LMI). The aim lies in developing such a method that neither involves camera calibration parameters nor inverse kinematics. The approach adopted in this paper includes transpose Jacobian control; thus, inverse of the Jacobian ma...
متن کاملVISP: A Software Environment for Eye-in-Hand Visual Servoing
In this paper, we describe a modular software that allows fast development of eye-in-hand image-based visual servoing applications (ViSP states for “Visual Servoing Platform”). Visual servoing consists in specifying a task as the regulation in the image of a set of visual features. Various issues have thus to considered in the design of such application: among these issues we find the control o...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Access
سال: 2021
ISSN: ['2169-3536']
DOI: https://doi.org/10.1109/access.2021.3071261